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ABSTRACT 
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Researchers working in foreign settings are often 
number of factors which are quite different from 

fence research activities in .one* s own cultore. The 
these , cultural differences can influence research 
gative way depending, at least partially on the 
ty shown by the researcher to the unique cultural 
the society in which he/she is attempting to carry 
ities. Data are based on experience and' interviews 
gathered while wotking in community development in Bolivia, Factors 
deemed particularly influential with regard to research efforts in 
Bolivia and in developing nations generally include educational level 
and literacy r at/tttudes, toward government within the host country , 
feelings of effi/cacy in social ?ind political "interactions, the 

ilieu, geographical considerations- (such as arranging 
views to coincide with the work/leisure cycle's of an 
endar) , and the influence of cultural differences on 
ion of data and findings. The > conclusion i)5 that 
rsuant 
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to conducting research in a foreign setting* can 
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every attempt to be sensitive to 
ncrea$ing /t5ultural sensitivity is 
1 to assist in the research 
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• * . •. , INTfi'oD UCTIOH * , - • 

Consultants and^^ntYaproneiirs fn both the private and public sectors a r^/^ 
more and more, frequently be ing requ! red to conduct systeinatlc research for the 
complettoh ^f^tasks they are dsslgrred. These range from, market I ng an c( locatlonal 
studies In/the private sector to progrjamatic and administrative Inquiries in 
the puBllc sectQr.l They also ransicj m thefr level of systematic discipline: ^ 
from ad hoc admin istrat iyg assessmgnt$ to logically deslgneid., empirically 
testable hypotheses of projects with specif ical 1y identifiable goals. ^ 

This paper draWs from^ delta through* personal experi^ce and interviews 
gathered^in Bolivia while working as a consultant to the fifatlond I Community De* 
'Velopment Service (KCDS) in the mid-1970s. The jilCDS has been"' the recipient . pf 
several loap's and grants from the Un I ted "States Agency for International De- " 
velopmeat. . ,A& a component of a loan granted in late 1972, the NCOS con- 
tracte^d for technical assistance in a variety , of areas. The pVincipaJ respon- 
slblllty of tt?osQ involved with the Consul ting effort was to. leave in place a 
formal evaluation system which would measjyre 'both the |uccess of the activities 
undertaken by the agency and the impact of those activities on the communities 
^involved. '^Secondary tasks included project planning, budgeting, training and 
marketing studies for Certain agricultural sub-prbjects. 

During a twelve month period in IJ73 and 197^ (and dOrJng several months 
again in t975 and 197^)^ the author was the senior ?dv* signed the respon- 

sibility of coordinating the technical assistance to the evaluation system. 
Two princijpal goals were desired by the "Servicio'' and the Al D' supporting units: 
some measurement of the community development process and success (exito) and ' 
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some measurement of/the*irtipact 



system permitted data col lectlbn dn the amount ^of contribu^ions from within 
the communities to permit the construction of projects (labbr--mano de obra", 
materials 9 or ca^i) and user rates for both social (school s» medical posts , 
portable water suppries) and eci)nomic' infrastructure (roads, bridges and agri- 
cultural projects). C^ta were ^Iso collected on the amount of governmental 

I 

(work days of promotional activities, the pre^* 



(Jmpacto) • The ul timate des ign of the evaluation 
tibn dn t 



\ 



effort placed in each community 



ense of other gover^iment agencies) to*^ see what relationship could be found be-* 
tween NCOS effort and success a» defined by the user rates. 

At the time of the study ihere were no base\l^tne data, thereby preventing 
the use of a pre- post- Intervene ion methodology. This necessitated the use of 

^ a post-project completion methddology , severly limiting the scope of the evalu- 
ation. While it was the desire of the ^ge^cy personnel to qoJ lect data which 
would demonstrate impatt (generally defined as "improved economic status")* it 
was not possible to draw the linkages between project design and economic Im- 
provement in the communities. The best that could be accompi i shed was to 
measure user rates and community contribut ions^to the maintenance and upkeep 
of the projects. Those projects constructed In rural Bolivian communities 
(with a population of 3000 of less) three years earlier were the subject of the 

^ Initial evaluation. Of 15^ Identified projects, data were^'col lected on 128, 

V/hen one becomes invoTved In applied research efforts in a foreign setting, 
certain ghai:acteris tics unique to the host-country culture become evident. Such 
characteristics can slgnii iucn. • ssuence the relative success of one's re^ 
search effprts. How awareand sensitive one Is to the differences between 
one's' own culture and that of the host country is not necessarily a new element 
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toward which Itttle attention has been directed. What is of concern in this 

^ *" it ' • , 

paper Is how those cultural differences influence the research ef4t>rt. What 

> . ' ' ' . ' ' - 

are the^e unique tharacteristics? How do they influence the various phases of 
research? What are the potential advantages or pitfalls that await the re* 
searcher irfio demonstrates or fails to display that sensitivity? 

This paper id^n^tifies several categories of examples derived fr^\he 
experiences in Boliv^ia. The first, educational level and I i teracy , looj^Vat 
these two factors and how they impinge upon research effort. The second area, 
trust in government and ef/icacy, looks at the di f f icult les pecul iar to working 
in a government organization in a society where skisp^icism and doubt best char- 
acterize peasant attitudes toward government. Third, the paper looks Into the 

organizational m4l ieu to understand both internal and external factors which 

* • 

^ dan influence the relative success of condqcting research. A final section 
looks at two other conditions before offering some conclusions. 
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Education obviously involves a broad i^ariety of cc^cerns, many 'of which 



are a consideration whether conducting research in one's native culture or in 
a foreign one. In this case, I explore two particular dimensions of education 
which directly influence fhe research effort: the level of education within 
the organization that conducts the research^ and literacy level%M3f the general 
population that Interact with the organ ization « k'^^ 

Organtzational Conside>:atioas * \ 

The range in^educat ional background of employees within the NCDS is ex- 
tremely wide. During the period of the research, 299 of the, nearly ^00 employ- 
^ ees were located in. the eight regfional offices; the remaining staff were in the . 
headquarters office in La Paz/ the nat ion' s capi tal . Most, all senior level 
st^ff in the central qffice had at l^ast a high school (colegio) educatfoh ^ 
and most of these had some uni vel^Y^^^ralning. University education was high- ^ 
est In tho^e technical af^as whlcn required prof^ess iona I degrees (erg*, engineer- 
ing or agricultural economics). In two instances NCPS personnel had sufficient 
graduate education and experience that the/ also Sierved as occasional consultants 
to world-wide organizations such as the' United Nations or the Org^anizat ion of 

American States, However, t|iese highly educated and experienced individual s 

- ' ' ' ' ' ' 

certainly must be considered exceptions. For^the most part, the^ organ Izat ion 

was staffed by Inc^^v 'Html s far . ^(S^ l^vol of university i.Jdlning. At the 
regional office level, at least one college-trained individual (usually an en- 
gineer) was employed. But the field-level staff (prpmotores) --which numbered 
over eighty — were seldom found to have more than a grade or two of schooling 
completed. I|t was this group of Individuals that had line respons>(^lTi ty an^ 
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constant epn tact wl th the "|x)puIation being served by the agency. 

, Vh?'Ke the educational level, qf Individual s wi 1 1 vary/ in^all organ iz^Mons, 
the wide gap^'tr^tween those with a t:on3lderable amount of formal' education and 
those with only a year or two can produce unique tensions for one involved in 
applied research tasks. The level of conceptual development and understanding 
among. employees will vary acco^rdingly. The ability to think in terms of or- 
gan izat I on general ly presented little difficulty for those with completed high 



school or universi^ty education. Vihen,we spoke of .research' design , developing 
measures for project impact, or ^he analysis of data, few of tTi^ ide^s presented 
confused employees at the, central office. This was quite significant as the 
intent of the consulting effort was to inst kutionaUze the capacii^y for on- 
going evaluations within the oVganizatloQ. ^ Yet at the level of af^ individual 



\^ has received but first- or second-grade e ducat ion , jone cattno/t expect such , 
ease, in , understanding. Care must be^ taken to explain how evaluations work. 



whatCtI 



^the intent is and how such activity fits within the organization; and one 
must allay any fears employees might have about how evaluation results will af- 

• . ' if 

feet them. Accordingly, the researcher* must be sensitive to the^ different 
capabilities of individuals at all levels of the organization. 

Lcivel of educat Tonal attainment in employees also influences accuracy in 
reporting and compliancy w'th direct^' 0$ for cwnducLiug the research. The ac- 
ceptance of new techniques and innovation meets resistance in all organizational 

' \ ' . 

J forms. This is exacerbated when the techniques have the potential for pushing ^ 
^yond such fundamental capabi 1 i t les of the staff as reading-or writing., For 
those with a minimum of formal education, requirements for cpl lecting and re- 
cordtng,xttMta that test the limits of one's knowledge- -even in tasks so simple 





as completing questions or Blanks on a formt-can severely challenge^ the reliabil 
Ity of the data gathered. WhMe progre^ss may be made in presenting ideas to a - 
centraT of f Ice staff capable of understanding the mode? or framework employed, 
Injtlal entKusiasm may have to be tempered and complexities reduqed to a more 
simple form sp as.to Insure accuracy l» that which is collected. 

I* 
n spite of the potential pitfalls attributable to educational^ back- 

• V * ■ \ ^ ■/. ' • • ^ ' . 

ground, it may become Imperative to rely upon the weakest link. Oec^use of the 
lar^ejTpAber of cases and the kinds of data that had to be collected In diverse 
geographic regions, we relied up6n those field-level staf fS>ha were al ready 
familiar with the program's efforts. In many c^^es, Jocations of specific pro- 
jects were too renote for easy access--yet field-level personnel^ knew and 
visited such communities on a regular basis. In^sdme Instances only field-, 
level personnel knew the specific site rocatlons--of fleers in the central 
office did not know all communities in every region pf the^ountry. Finally* 
any data^col I ect iora effort that involves 150 projects In nq^ly^the sam^ num- 
ber of communities is too large and diverse for one individual ^to cover. For 
these reasons we chose to utilize field-level personnel " .r da: 

To insure rpi .j^nrrv ' -!»ltc ^^t;! of educational attainment of 

Che data cqI lectors we took several- precautions. Fi rst, we attempted to balance 
the need for extens i ve amounts of information with the potential . for*error in 
data gathering. One cannot expect an Indlv^i dual who has only minimum reading 
and writing skills mastered to complete a queistionnaire about a s i te that re- 
quires extensive narrative statements or complex data compilation or calculation 
Such trade-off obviously limits the comprehensiveness of the study and the sig- 
nificance of the findings. But the alternative is to have a beautifully de- 
sign^ed study which generates no valid information. 



a 



Second / at the outset we involved selected flel'd" staff to assist iqf idea 
generation. This served to temper the ideal istlc ^expectat ions of the rej^earch 
by providj^n^ general information about the comn^unities being served, the vaHety 
of projects being implemented and the working erTVirtMiment of the organ i/zat ion. 
In the process of designing and field testing the^ questionnaires, we were made 
aware of the unique nature of secondary and tertiary indicators of ecbnomic 
wealth in the communities r glass in window openings, ownershlp^of bicycles or ^ 
transistor radios, materials which roofing on houses was constructed. Tfils in- 
teraction also provided 'those fiejd-l^vel employees with the opi)ortunlty to be- 
come aware of the research endeavor. It served to lessen anxiety abour the pur- 
poses of the effort and built confidence iji data collection activities for those 
who wouJd ultimately have the principal responsibility during that phase.' 

Additionally, once the desl gt^^ phase was completed, we held pre-col lection 
seminars involving all field-lf^-^ >cr^.;.-<^el . . We we^e pemftted the ^Jme and 
resources necessary to he ' two iucr somina- ? -(o^e on :sitiplano, anotr'- in 
the Cochabamba reg^ion). The training seminars permitted the only formal ex- , 

planation to all field personnel why such a proces^s is* necessar^and provided 

■ * 

the only real opportunity to specifically guide those collecting the data. A 

brief general discussion of the datcT collection process, was giverl wit>h the 

) d ' ^ i . \ " 

identification of specific difficulties we anticipated data collectors might 

encounter. We also cjevlsed a brief simulation with .some Tole-Iaying to faciU'- 

tate the learning process. This brea'ks the ice for the skeptics by, fami 1 larl z- 

ing participants with the processes to be followed. Everyone was permitted the 

opportunity to play botR the roler of data col lector and of respondent (In our 

case 9 community resident). ^ J • ^ 



I Fjnany, reliabil ity checks might be required toXinsdre tha^ accurate 
data has been gat^he red. We delegated .oversight . responsiOv^I Ity to the direc- 
tors of the regional 9f^}ces. Rather than =heive such responsibility remain in 
the hands of a foreigner, or even someone f^rom the ceatral ofVi^ce, we felt 
directive's from Immediate supervisors w6uld be' less threaten ingy.^ H^fe also felt 



that degating such responsibility would fa??1irtate Inrsti tut i^na^I ,12a t Ion of 
the process. Personne^ in the central office prdV I ded $1 third me^'s, for 
reliability checks by spot glances of received questionnaires. Fpr th^se 

'^orms with obvious errors or suspicious tlata, additional checks were run with 

> ■ - ' ■ .-^ • ■ • ' 

data already compiled In^ central office files. ' 

i ■ ^ • 

Population Considerations ^ //* '* * V ' 

J The. second dimension of education and 1 i teracy deal s wl th th^e who are 

going to supp^ - (J^ata from the corwnun I ty ./\Jwo- probl ems present themselves. 

* ^ • . . ^ - . ' ^' , ^ 

First, the I eve of education and literacy create potential dif^flculty in keep- 



ing records. This; in turn, presents reliability questions as iTteV^cy g^- 

eraMy pjUceeds accurate record-keeping and organization of Information. 

Second,' while language itself may bp a- problem, paftic^Var difficulMes arise 
« 

whesn oAe fluids several subcultures which make tr| -I i.ngual Ism the medium for 

gathering data. > ^ ' ^ ^ 

;The l-ttejacy rate in third-world nationsf. varies greatly; it signifi- 
cantiy low inrBol i via .where approximately 62^ of the population cannot re^ad or 
wrlt^.."' this^ becomes problematic in collecting data if no one In the community 
Is capable of keeping formal records on v/hat has transpired during^ 
completi^^ o^ project construction. In communities, where schools we^rte*" the desig- 



nated pro/ectV mosMfed teachers (a few did not). In'stich cases ,a^ie<^eacher 
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is the ideal contact in the communl ty • Howeyerv i>1 Bolivia only 55% of the 

' • -'^ • ■ ' " • ' • V ' ■ ■ \' 

teachers are graduates of horma.1 schools. , In spite of this general stati'stic^, 
'mbst teachers we^re the only individuals in the/ Communi ties to have comn^nd o^ 
the languages, and they were also highly respected indivljiduals. FurtherrTK)re^\ 
much of the* data we decided to be most useful and infornr^ive in our analyses! 

was available through records Kj^pt by local s^cfhool teachers (more so^ in school' 

■ . • ' ■ " • . . ' . .'■ • ^ ■ ' 

projects). But this was generally the case even In thc^se communities where 

projects other than schools were included in our evaluation. At that, in our 

investigations we found that some schools did nqt have a teacher assigned c0n- 

tinuously* (over three or four" consecutive years) * In couple of examples, 

the remoteness of the communj ty was too mutia for the teacher who Veft before ^,a 

year was complete. , / , ,/ - 1 

/ In thbse communities where accurate rec^rds^ are not kept or where#no one 



in the community, formally records any Information, the problem i? considerably 
more complicated. V/hile such^ses were rare, in our inquiry, one is left with 
two ^al tdrnat Ives. Either the data must be pmi tted or further i rryest i gat ion 
must d^ermtme what inj^ormation is available. Again, reliability may be a ^ - 
factor,^Jpr if cqgimunity^res i dents do not keep wrf tten records , the po^s iJ:)i I i ty 
exists that incorrect data r^ay be siippli^ by the respondent, i In ylHwnarV, cont 
tinuity of record keeping can be quite troublesome in the collection of re-^ 
, 1 lable data. ^ ♦ . ^ ' 

'\ vVothfng has been mentioned of the fact that in most research conducted 



In Latin Amertca, a second i anguage--fQr -most Nort^ Americans--is &lso -requi red. 
Certainly, a facilltyof that language i I provide additional ease in the work 
tjD be completed. Furthermore, ip/hen one ventures into research for the first 
time, generally a special ized vocabulary must be yevei'CJi/ed. This ^s true in 



PW%E?ni specific and research specific instances. Colloquialisms also may^^be 
.predominant In different regions which necessitate careful wording in a secorfd 

':)anguage. : ' ^ ^ • . r 

■ ■ -.1 ■ • •• " . ' " " 

-f - • ^ ■ , - 

\\ In Bolivia an additional language, problem cqmpi I'ca ted the research ef- . .* 
fort. As many as Half the^populatibn do not speak Spanish, but rather the^^ 
Indlgenpus languages of Quechua, AymaVa ^and^ Guarani , Thus a ^latlve North Amer-^ 

V. . / . ^ ■ ■ I > ' ■ . ' ' 7> • • '. •■. ^ 

Icani^can find him/h^eVself using a second language (Spanish) for comrtunicating .'^ 
with^fleld staff or community residents who also use Spanish as a second language 
\WIth field staff this generally does not present problems as the I r^bi I ingual. 
ca^bttities are quite good.. But in certain communities, it may take a. pqrlod 

of time, to lox^ate an individual who is capable of f'luen'cy in their seconci 

_ \. ' \ ■ . ' ' . 

laHgiuage. Obviously, the more remote the village, the greater the Ukellhood 

of sucli art occuraxice. In any case, language difficulties al-so necessitate care- 

fwl consideration .in both questionnaire design and in data collection. 

TRUST IN GOVERNMENT/EFFICACY ^ 
A second category of c6n,cerrij5 In wKich researchers in a fore igl|, cul tul^q ^ 
may become in vol ve\i d^s with the relationship between the citizenry and the 
government. Trust m government and politick efficacy as perceived by com- 
munivj^ res iden^s (andy '^n our case questionnaire respTQ^rr^^ts) can also significant 
V th^^^ucce^^ of the research^efldeavor. To §^ large extent, boti=« fao;- 

tors are relate; bSi^M separate them for the pufl^oses of ^underst^nAlng how 
each inffuences different a3!p,ects of the research. >p 



. wvl believe it safe to say tha^Jihe level of trilst m government- bv^^e^ 



peasai^try^ is conside>:ablyl lower in Bdl ij^ia than we are fami 1 i^ with ih the . 



\ 
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Unlfe^ States. V/hjle we are j^xpoSed to public dplnlon polls which frequently 
ask the citizenry how they feel about such trust, polling and pulse-ri^glsterlng 
devices are ^lot so common in Latin American^ natipns. Several ^factors which 
are different in l<inci from' those, in North .America contribute to the level of' 
trtis^t^ in an9 given n^)Lion. • First, Mribst government services are not as numerous 
- nor do they reach' as extensively throughoutSthe popul at ion'^ in many countries. 
For example, the U.S.. gov^rnpent estimates that" some 300,000 chi Idren^qtween 
the ^ges of 10, end 1^ have no aqcess to formal education; and that about^^half 

the populai^ion has access to mec^ical attenti,on, mos*tIy,from public institu- 

6 

tlons. Such statistics are not conducive to buildifig confidence aFuL trusjt ih 

' ' *' , 

government. The polTticaf history of the -nation is an additional factar which 
. ^ V/ 

Influences the levef of trust. ^ In countries where- freer and|[more >j^en pol i t leal 

" ■ .. ' _ ' ' ' ■ ^ ' /' \ ' . s . 

processes pre^lominate, fear of governmental involvemer^t In the community Is 

likely to be lessi prominant. Conversely, in a nation that has had a history 
of qIvM violence or a series bf Military regimes wh-ich frequently find them- 
selves in conflict with the peasantry, the wearirtess of civilians toward those 
whO' represent the government is likely to be high, Given the unique character 
of such attitudes, place yoi^rself in the role of^ ^ researcher, quest iJRna i t^e 
and pencil in hand, walkjng into a community to collect data. CaV^/'it one 
step further, what might happen if one wished to<ollect data at the level of 
the in^i^vidual or household? . 

*T[n the design of an evaluation system to measure the contributions iff 
infrastructure projects to tbfe economic well-being of a^ community, the objec- 
tive is to^ demonstrate thq link between the change in economic conditions and 
the project. This entails controlling for a wide variety of possible inter- 
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• venfng varfables — a di f f Icul t task in and of itself. But assuming that Ms pos- 
sible, pne needs to dev^el op. indicators of changed cond-i fions . As census tak- 
ing and tax or incofne data arCi not generated by anyo^pe in any regular or system- 
atic fashion (^f at allj, ft becomes th<^ Jt*^oarch task to Identify in- 

dicators. The logical place to st ' level of the indi- 

vidual or household. However, thi jMr uirect quest ioniri^ of indi- ^ 

viduals (with data reliability issues raised) or secondary indicators that 
represent I ess obtrus i ve measures. We deliberately delayed collection of per- 
sonal- or household-level data for two reasons. First, we didn't want to receive 
wide variations in successful entry into the different communities (where one 

"might collect data easily in some comrrfunities and get absolutely closed out in 

others). Secondy rel iabi 1 i ty of information collected might be dubious. We 

'' ' i. ' > # 

were frequently Warned about strangers entering i n the commun i ty to coHect 

/ ' ' - 

data as they were perceived by residents as being government representatives 

col I ecting information for the purpose of taxatfbn. While the likelihood of 

sucji an individual appearing in a community is remote/ in my opinion, the con- 

cern of community resident who lack confidence in the intent of government, 

could be quite detrimental to the collection of reliable data. 

Aside from the facility of having the manpower to assist in the collection 

of data over a wide geographic area, this was another factor (the fear of 

strange government information collectors) which influenced the selection of 

field l^el personnel for data collection. With individuals who are known in 

the community, their association with the government in any negative connotation 

is- minim) zed. 'A stranger, particularly a foreign stranger, would likely meet 

with more resistence.- While we felt we had identified ind icators which would 
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assist tn the measurement of economic improvement, the obtrusive nature of 
such an inquiry guJded our decision to postpone that set of questions. . 

Efficacy also may present unique considerations for the applied research 
effort. The Bolivian Community Development Service ^ wh ich employs a self-help, 
locally initiated and oriented program, functions under a non-democrat I c mj 1 i - 
tary regime. A fundamental precept f the community devel opiDent process i s\ 
that ^ij^munity members work together in some coMeci. f\ m to identify com^ 



munity problems and agree on some means to resolve those problems. This is ^x. 
precisely the job of field-level staff (the promotores) : to facilitate that 
process.^ At the same -time, the agency is an arm of a government desireous of 
positive visiblity in the countryside that assists in the construction of needed 
infrastructure. The push from the government is to have tangible results de- 
livered by the regimfe with less^concern for the process involved^f*^ 

These dual, ^nd potentially conflictu^l, perspect iv^' al so present 're- 
search design difficulties. As field-level staff are responsible first for 
the activities related to project construction, they may not perceive the 
Ity of collecting data for evaluation purposes. The previously mentioned train- 
ing seminars provided an opportunity to explain the value of such information 
and illustrate what the intent of data collection was. Furthermore, in the de- 
sign considerations, one must weigh the appropriate value each perspectfve is 
« 

to receive during the analysis. • Mow much should the inquiry reflect upon the. 
process? How much should the inquiry be directed to illustrate the success- 
ful entry of the government Into the countryside? Indeed;^in the case of 
Natioifial Community Development Service, agency personnel prided themselyes on 
the belief that the agency was one of the few arms of the government which en- 



s 
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joyed a high degree of popularity among the peasantry. While this was the 
case precisely because of the effectiveness of the field staff in successfully 
entering the communi ty ^and gaining a certain confidence among residents, it 
put a certain pressure on the research effort to have an evaluation system 
which reflected that success. On the other hand, the I nten t ion of . an evalu- 
ation system is to illustrate b^yi||y:rengths and weaknesses of program ac- 
tivities; to find out what j||p|i^^H|pt does not; to Identify, if possible, 
what community-wide changes^BHpPI'ed because of the construction of needed 
infrastructure. Thus, design work must permit the collection of data which Il- 
luminates an open inquiry into the successes (or failures) of the community • 
development process. This would more than likely Include some measure of 
government popularity. 

ORGANIZATIONAL MfllEU ^ 
A th i rd ^category of concerns involves the orga^Jfzat iqpal setting within 
which the research effort is conducted. The influence of organizational con- 
ditions on resear^h^^and evaluation is a fact .noted in the literature exten- 

7 " ^ 

sively. As In a domestic setting, the researcher must be cognizant of the 

organization and i tb environment. Pressures on the researcher in ^ foreign set- 
ting jnay be aggravated because he/she is an outsider who mu^t be aware of pas- 
sible resistance to suggestions or recommendations made. I use. the distinc- 
tion between internal and external factors to iljustrate potential obstacles 
to the reseaVch. 
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The "^Internal Di mens ion 



The evaluati/on research with the NCDS provides tiwo examples to illustrate 
the potential difficulties associated with the internal dynamics of the organ- 

f * 1 V 

ization. One o| the crucial factors to insure utilization of an evaluation 
research effort /is the divisi.on within the organ i zat ion that is assigned the 
responsibiJ.i tiesl of design and analys is. In this case, the division respon- 
sible for the sifcud^f ccpmu^P^ and conditions wiv influence the field 
workers' doma ir| ^Pfe DI v is Jot oi west i gat ions a : 'raiding. The division 
had two sectior^s related to each other only in the vaguest ways. The training 
section was responsibl^for conducting seminars for NCDS personnel and for 
selected communities' leaders who -were brought together for instruction in the 
community developmenV>Facess . The activities of the training section were im- 
portant as they^ prov i ded a basic understanding of the processes involved 
through a course d i re cte^ toward potential recipients pf NCDS activities. The 
Investigation section, on the cfther hand, conducted in-depth community studies 
using ^n anthropological approach. Lack of funds iand general disregard for 
the investigation function by the organization's leadership had led to the sec- 
^ tion's relative lack of importance in agency decision-making and a decrease in 
, the numbe^r of studies conducted. Locating the responsibility for design and 
analysis in this division (the or i g i na l^ntent ion) was tantamount to death of 
the research and whatever the analysis might demonstrate. ^ 

To facilitate the incorporation of research findings -into the decision- 
making process, it was decid^^that evaluation activities woulcf be incorporated 
into a newly created planning and evaluation section, directly accountable to 
the agency direcJ:or. Such action obviously has far-reaching implications and 
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one mus't be aware^bf the potential drawbacks to such recommendations. Long 
held attitudes and val ues ^become obstacles.»to change and the foreign researcher 
can easily aggravate an already delicate situation. 

^ A second internal cons iderat^ion was the necessity to insure the cooper- 
ation between two distinct and independent divisions.' In this case, the cooper- 
ation involved sections in the central office and the eight reg iona T of f ices . 
Planning, desigh and analysis responsibilities rested in the central office; 
data collection respons i b i fi t^^^^re assigned to field off ice personnel . The 
former activiti.es took place within a group that operated relatively freely and 
generally with its own independent scheduling. The latter were responsible 
to regional directors and also operated within their own se'l f -establ i shed 
schedules. Fortunately, coordination between these divisions were required with 
Other activities. The training seminars involving community residents required 
the identification of participants f/om- the commun i t i es by field-level staff. 
Schefdul (ing , requi red close and continuous communication as there were only two 
training facilities in the nation. Even the investigations section required 
coordination with those promotores vyho worked in'' the reg-ion where studies 
were to be conducted. Costs for failure to coordinate In a research effort are 
significant. The majority of the commljn i ti es from which we were unable txj col- 
lect data came from or)e particular rcg iona I of f ice . V/h i 1 e \i was fortunate 
that only a relatively small number of projects were omitted* timing of the 

analysis pjrohlbited applying additional pressure and waiting for the results. 

f ^ \ , . 

Both of the exampl es --where to assign responsibility and the coordination 
among d i v i s ion s --se rve to illustrate potential compl i\cat igns and the awareness 
a researcher must develop to insure successful Implementation of any research 
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effort,. In considering the internal dynamics -of the organ i zat ipn , care must 
be taken to understarid the idiosyncratic rrature of the personalities involved, 
the particular ways in which tasks are accomplished or dfsputes are resolved 
in the organization, and the cultural characteristics which influence the or- 
ganization's operations. 
f 

The External Dimension 



The external environment of the agency represents the second dimension 
of the organ izat ional milieu. Again, the literature in organizations is re- 
plete with the significance of the organ i zot i on ' s environment.^ Con^cting re- 
search for a foreign governnl|nt adds an additional complexity. The relation- 
ship between donor and recipient agencies ra i ses the issue of compliance with 
donbr-a^ency demands or requirements. ^/ 

In the NCDS example, a requirement was made for the design and implementa- 
tion of an evaluation system in order to receive a loan. This placed the 
rjBcipient agency in the position of need ing ^someth ing tangible to comply with 
Ihe loan agreement. Here, the loan agreement (Established a "condition precedent' 
(and earmarked the necessary funds) for the iJCDS to develop, an evaluation com- 
ponef)t. Such a sitaation, of course, can facilitate cooperation with agency 
personnel. But i\\\f> ii not necessarily the case. First, the agency may not 

^ / - ' . ■ 

be aware of the complexities involved ih such a research effort. Second, the 
personnel may be willing to agree? to a conditjon precedent because it permits 
the awarding of a-loan, not because of'any inherent comrjii t/nen t ,to the idea or 
the results which might be ' f or thcomi ng . Third, the agency may not be aware 
of the additional costs which they may incur and w^hich may not be covered by 



the ]oar) agreement. Such costs must be born from^unds beyond those granted 
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through the loan. ^ For^^^i^i ^ ^, travel and per diem costs incurred with the pre- 
collection training senx^j^^gjppov ided to field-level staff had to be assumed 
by funds from the Bolivian government, • 

The issue of relations between one agency and others within the hos t-count<ry 
government may also be of concern to the researcher. Some agencies may find 
themselves wi th cons i de rabl e dependence upon other agencies in completing their 
activities or mfssioos. Questions of territoriality qr prestige- can Influence 
the degrge of cooperation one might encounter. Hostility might exist because^'. 
of a lack of communication between a central planning agency which knows noth- 
ing of the host-agency's loan obligations. An agency such as the NCOS might 
also require the cooperation of other s.ervi ce-provi d ipg institutions once the 
local infrastructure project has been constructed. Schools necessitating the 
placement of teachers is a classical example. ^ ^ ^ 

It has been noted that inter-agency cooperation in, Bolivia is a problem, 

' ' . / 10 

anci not always because of poor^relajtio^ between agencies. In the dat^^ol- 

lection and analysis we found several examples where coordination was quite 

necessary, but had not occured. The N<Ji)S const^ructed many schools and several 

medical po^ts as part of tb^ir community development programs. In severM 

cases, whil^ very rare, we found that teacjiers had no^ been assigned by the 

Mini^stry.of Education and were left vacant. We also found an example of a 

building constructed as a medical pdst, then used for cvbp. storage because the 

m< 



Ministt;^of Health could not^equip or ass*ign medical service personnel to staff 
It. In the design of the evaluation we were concerned with identifying how 
successful the agency was and attempted to Tdenttfy what difference such sutcess 
had in the community. In the preceding examples, one^^^e^n certainly conclude a 
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relative anxjunt of success in project construct ion , but little in the v^y of 
u^ i I i'zat ion--a t least as designed. The way inyv/hich the research a|:counts *for 
such ,f ipd i ngs influences the outcome of the evaluations. While such finding^ 
wetild suggest the need for cooperation in the future, action taken b^sed upon 
the results may be inhibited because of long-standing an i m^s i t ies be^een two 
agencies or bepause there are not sufficient funds. 

OTHER-^ CONS I DERATIONS 



^ On^ can identify two other factors which do not fit within the previously 
mentioned categories. Onelof these is a geographical c^ns iderat ion\ the other 
one involves the presentation of analysis and findings. Aside from the ^b- ^ 
vious d i f fe rences- in the norttiern and^ou'thern hemi sphe res . ( remembe r , therr sum- 
mers are our wiaters and our summer^s are ".their winters), attention mUst be 
paid to the implication of those d i ffer^ences . As the f^CDS was concerned wTth 
rural^ commun i ty development, thi^"'^>ram(5le is peculiar to the rural environment. 
A unique aqr i cu 1 1 uVa I calender influences the act i vi t ies of the rural vpopol a-* 
tion, and subsequently, that, of agency field-level personnel. The planting and 
'harvesting seasons are relatjvely short in certain regl^ons of Bolivia. The 

wet an^ dry^^^fc^sons are also unique. Accordingly, th_e amount of time when ^ 

*^ • • , . ' 

subs i s ten ce- 1 eve I" farmer^ have freedom to engage in' communal activities is some- 
what restricted. This becomi^ s i^« i f i can t in determining when and how fiel<J- 
level ^staff can coordinate their plartning^nd promotional activities. Release 
of funds from the agency which are held up because of admi/) i s t r-a f i ve difficultly^ 
can delay project construction for ^ complete year. This can ha vci a/^i gh ly 
detrimental effect^on community en th us i asm and cooperation. As regards utifl-^ 
Ization ^cJt agency personnel in the research effort, timing of the data collec- 



tion activities must take into consideration the constraints attributable to 
the agricultural calender. Agency personnel irojst be able to free themselves 
f i^3(tr-^f»ofeyon'al activities in s.ome communities^^ permi,t evalJll(jten activities 
In^others. Planning of the research '^fort mu^^.t, accor-di ng! y , consider the 
agrlgiilturai calender and its impl icat ioli3 for community res ide?K(s and-agency 
personnel • respons i ble for data col 1 ec tion>-* ^ 

The f'inal concern to be addressed irivcHves a combination of se\l^eraj/ of 
the_ prev ious ] y mentioned issues. To be useful, an evaluation must provide in- ^ 
formation in ai^timely manner with decj s ion-relevant (fata. At the same time^, 
the individual responsi ble^or the completion of the work task must maintain ^ 
allegiance to the methodology of evaluations. Ultimately the analysis provided 

must be presente<T to decision-makers for incorporation into their processes. 

- - { 
Alas, evaluations can not, and frequently do not, provide everyone with the in-- 



formation they need, or in some cases, the information they want. i And decision 

makers will Qrocess the information throu^ their own iDercept ions . * 

\ . ' . . 

A f inal i 1 1 ust rat ion of how cultural differences can ./Tnf I uence the re- 

I ^ . > ■ 

search effort iS/in the j-nterpretat ion'^of the data, generated on several medic^-l 
pob.ts. User laLes llluslrdling the exteiil*-of services provided^ number of 
/patients treated, cjn<i costs asso^-iated w^ ih each project were made availai)lc: Lo 
three sets of in^lv^feials. Each grotq^ responded "d i ff^ren tl y and in accordan^-e 
with their needs .and perceptions of relevant information. The leadership of 
the NCDS were particularly pleased with the findings. The general response 
might best be sumti^arized by the quote, "Look at the number of people now re- 
Iceiving meoical treatment who previg^usly had to do without.',' The project mana- 
ger of the AID Community Develodjment Section was pleased that the data and 
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; analysis were in, The eVa ^ ^ first run v^s i^ipl'ete f^l^he ^ 
original goal accompli i^fehed/^^^^e l^^HoflFJcer within t|pe Al D.nji ss ion ^ref I ted 
an interpretation unique to the position he held: he quiqkly [bulled out pencil 

( . • ■• > . - 

.and pad, calculated a r^lat ions'hi p between ^rojecf cost and the number of in- 

c 

dividual s served, and concluded that the cost-benefit r.^io w^s insufficient' 
and questioned the value of continued efforts in the construction of medical 
poSts^ ^en in the xjse of data p,resented, cu 1 tura 1 ,^i f ferences, accoun t fdr 
varying interpretations. ' '"^a 



CONCLUSIONS 



Conducting research in a foreign countryi requi res being cognizant of the 
unique cultural, setting and tW^ potentfel diffioulties oneymi^ht encounter. A 
researcher's sensitivity to' that cultural setting can i'nfluencfe the success of 
one's efforts/ The categories of education and literacy, trust 'in goVernment^' 
and effij^cy, and the organizational milieu are merely conveniences for under- 
» standing how cultural factors can effect the researcher's activities. The re- 
lat|&d difficulties are overcome fiow sensitive one is to that foreign cul- 
ture. 

Any reseSl^ch activity in a foreign :>ettjng should resuJt^n a learning 
exper^ience for the researcher. In the role of consultant one certainly brings 
.1 .Expertise to be transfered to the recipients of the^ervice provided. At the 
same time One gathers extensive experience which can and should be returned to ' 
his/h e^r n ati ve cultiye. Reliance upon host-country personnel to assist in the, 
research activity provides three benefits to all concerned. \^Fi rst , it f ac i 1 i - 
tates adoption of new techn iques^for tfhose being trained^ Hands-on, supervised 
experience provides immediate feedback and build confidence. Second, utilizing 
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aclvice and qpunsel of fieU-Ievel personnel enricfies the data collected. One 
often, fails to ask the right quest i6ns, assuming that their own perspective 
is the appropri-ate one. Look^n'g^to those who understand and know the envirbn- 
ment can compensate for cul turat bl Trjders worn unknowl ingly. Finally, -the 
irj^i.ghts provided by host-country^persOhnel can be incorporated into the^re^ 



searcher '"s world view. 
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'MOTE,S^ 



The loan through which an evaluation system was mandated w5s the third from 
AID to the MCDS.^ The total amount of the Joan v^as (US) $3 million. \ Al- 
liance 'for Progress, Loan Agreement, AID Loan No. ^II-L-OH, September 15, 
1972. . ' ' \ ■ 

A particularly insight/ul book which treats the nexus of cultural change 
and tecfinojogy is George M. Foster , f rad i t Jonaj Cul tures : -And the I mpact 
of Techno log^ical Change (Mew 7ork: Harper and Row, 19&2-) . ' - 

Development Assistance Pl^n , United States Agency for international D0«7 
veloVmenty^Vashi-ngton, D.C., 1975b); p. vi i i ' • ^ 



Ibid. , p. 10, . , > ^ . . ^\ , 

Ibid ., p.. 9. . \ ' ' 4 . ■ ' ' - ' • 



Ibid. , p, lo"? / » 



S'ee, for example. Carpi Wei?^, E^valuating Action Programs ^(Bostbri: Al lyn 
aod Bacoh, 197?)... * ' ' ^ ^^^^^^ "* 

All textsi" i nLpubJ id AdminTstration-Nxievote a «fgn .•ft cant poVtiofi to the , ex- 
ternal envi roinmen t^ of organizations. Two of the more recent ones are J.D. 
Wf^ 1 i:^ms , <' Pubri c Administration : The Peopl ej s jius iness (Boston: Little,. 
Brown, 1980) and Harold F. Cortner, Admin isti/at Ton In the PoIIjI ic Sector^ 
2nd edition (Wew York: Wi Uy and Sons, 19«U . ""^^ ^ 

A '-'condition precedent"^ 'i n AID parlance is a requi^meat to be m^t J^efore 
or during th6 disbursement of the loan. Failure to comply can result in 
h^lltf^ng the transfer of money. 



devel opmen t Assistance Plan, p. 10. 



